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(54) INFORMATION INPUTTING METHOD 

(57)Abstract: 

PURPOSE: To input a large number of information in the 
case that the information for an indicated object body is 
inputted to an information processor by the motion of an 
indicating operation body like the hand and the foot of a 
man or an indicator. 

CONSTITUTION: First of all, the coordinate position of 
the tip point 7 of the hand 6 in a three-dimensional 
space O-xyz is determined from the tip point 7 and a 
reference point 8. Next, the specified state or state 
series of the hand 6 is discriminated, and the information 
determined beforehand in accordance with the state or 
the state series is inputted to the information processor 
9 as the information for the indicated object body 5, etc. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Are obtained from two or more image pick-up equipments arranged so that it may have a 
different visual field to the directions actuation body which directs directions target bodies, such as 
an operator's hand and foot and an indicator. Two or more image pick-up signals of said directions 
actuation body are processed, the coordinate location in the three-dimensions space of said directions 
actuation body is determined, and this is inputted into an information processor. Said directions 
actuation body, Said directions target body which exists on the straight line which connects the 
reference point appointed beforehand is determined. The informational input approach which 
identifies the specific condition or its specific condition sequence of said directions actuation body, 
and inputs into an information processor the information beforehand decided corresponding to this 
specific condition or this condition sequence as information over said directions target body etc. 
[Claim 2] Are obtained from two or more image pick-up equipments arranged so that it may have a 
different visual field to the directions actuation body which directs directions target bodies, such as 
an operator's hand and foot and an indicator. Two or more image pick-up signals of said directions 
actuation body are processed, the coordinate location in the three-dimensions space of said directions 
actuation body is determined, and this is inputted into an information processor. Said directions 
actuation body, Said directions target body which exists on the straight line which connects the 
reference point appointed beforehand is determined. Specific actuation and the specific condition of 
said directions actuation body, The informational input approach which inputs into an information 
processor the information beforehand decided corresponding to the combination of the arbitration of 
the speech recognition result of the voice of said operator by the voice recognition unit as 
information over said directions target body etc. 

[Claim 3] Are obtained from two or more image pick-up equipments arranged so that it may have a 
different visual field to the directions actuation body which directs directions target bodies, such as 
an operator's hand and foot and an indicator. Two or more image pick-up signals of said directions 
actuation body are processed, the coordinate location in the three-dimensions space of said directions 
actuation body is determined, and this is inputted into an information processor. Said directions 
actuation body, In the informational input approach of determining said directions target body which 
exists on the straight line which connects the reference point appointed beforehand The 
informational input approach characterized by equipping said image pick-up equipment with a light 
cut-off filter while illuminating said directions actuation body using one piece or two or more non- 
light lighting systems, in case said directions actuation body is picturized with said image pick-up 
equipment. 

[Claim 4] The input approach of information according to claim 1 or 2 of equipping said image pick- 
up equipment with a light cut-off filter while illuminating said directions actuation body using one 
piece or two or more non-light lighting systems, in case said directions actuation body is picturized 
with said image pick-up equipment. 



[Translation done.] 



http://www4.ipdl.inpit.go jp/cgi^^ 1/7/2008 



JP,05-019957,A [DETAILED DESCRIPTION] 



Page 1 of 4 



* NOTICES * 

JPO and XNPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention regards human being's hand and foot and a motion of a 
directions actuation body like an indicator as a direct image, and relates to the information input 
approach which inputs into an information processor the information expressed by motion of this 
directions actuation body as information over a directions target body etc. by the image processing. 
[0002] 

[Description of the Prior Art] Generally as an input device of current and an information processor 
(computer), the keyboard, the mouse, etc. are used. A certain amount of skill is required and 
everybody seems however, to be unable to use it immediately, when using these equipments. It is 
thought that current and the thing with much people "a computer is difficult" have the cause also in 
such an inferior interface. Properly speaking, conversation with a computer should be held as human 
beings talk using the same natural approach. The interface using this point and a "gesture gesture" 
can be used simple, without anyone's taking skill, and it is thought that it contributes to 
implementation of "the computer which can be used for anyone" greatly. Japanese Patent 
Application No. No. 053565 [ three to ] "the information input approach" solves a part of above- 
mentioned problem, detects the location of a fingertip or an indicator from the image inputted from 
the television camera, and performs specification of a directions target body, and recognition of 
instruction actuation. 
[0003] 

[Problem(s) to be Solved by the Invention] The Prior art mentioned above has the following faults. 
[0004] (1) Although "Specific actuation of a directions actuation body is identified and the 
instruction information over a directions target body is inputted" is written and the switching action 
of the thumb is specifically used about the input approach of instruction information, the instruction 
information given is restricted in discernment of only actuation of the specification of a directions 
actuation body. Moreover, the instruction actuation which must always be continuing [ necessarily ] 
directing a directions object object, and does not include directions actuation is also considered. 
[0005] (2) Although it is written that specific actuation of an intermediary and "directions actuation 
body is identified to the input approach of instruction information, and the instruction information 
over a directions target body is inputted into it", human being does not necessarily direct only using 
a gesture gesture. 

[0006] (3) About logging from the background of a directions actuation body, "a directions actuation 
body is cut down from a background and binary-ized processing is performed" is only written. 
Generally, change of lighting conditions changes the threshold at the time of being binary-ized 
processing. Moreover, an operator is made to feel unpleasant when special lighting is applied, in 
order to keep the logging engine performance constant. 

[0007] The 1 st purpose of this invention is offering the informational input approach which can input 
much information into an information processor. 

[0008] The 2nd purpose of this invention is offering the informational input approach which can 
input information into an information processor in a more natural form. 

[0009] The 3rd purpose of this invention is offering the informational input approach in which the 
stable image processing's is possible, without being noticed by the operator. 
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[0010] 

[Means for Solving the Problem] The 1 st informational input approach of this invention An 
operator's hand and foot, an indicator, etc., Are obtained from two or more image pick-up 
equipments arranged so that it may have a different visual field to the directions actuation body 
which directs a directions target body. Two or more image pick-up signals of said directions 
actuation body are processed, the coordinate location in the three-dimensions space of said directions 
actuation body is determined, and this is inputted into an information processor. Said directions 
actuation body, Said directions target body which exists on the straight line which connects the 
reference point appointed beforehand is determined. The specific condition or its specific condition 
sequence of said directions actuation body is identified, and the information beforehand decided 
corresponding to this specific condition or this condition sequence is inputted into an information 
processor as information over said directions target body etc. 

[001 1] Are obtained from two or more image pick-up equipments arranged so that the input 
approach of the 2nd information on this invention may have a different visual field to the directions 
actuation body which directs directions target bodies, such as an operator's hand and foot and an 
indicator. Two or more image pick-up signals of said directions actuation body are processed, the 
coordinate location in the three-dimensions space of said directions actuation body is determined, 
and this is inputted into an information processor. Said directions actuation body, Said directions 
target body which exists on the straight line which connects the reference point appointed 
beforehand is determined. Specific actuation and the specific condition of said directions actuation 
body, The information beforehand decided corresponding to the combination of the arbitration of 
said speech recognition result said operator's voice by the voice recognition unit is inputted into an 
information processor as instruction information over said directions target body etc. 
[0012] It equips image pick-up equipment with a light cut-off filter while it illuminates a directions 
actuation body using one piece or two or more non-light lighting systems, in case the input approach 
of the 3rd information of this invention picturizes a directions actuation body with image pick-up 
equipment. 
[0013] 

[Function] According to the input approach of the 1st information, much information can be inputted 
[ rather than ] to a directions target body etc. According to the input approach of the 2nd information, 
since an operator's voice is used, information can be inputted in a more natural form. According to 
the input approach of the 3rd information, the image processing stabilized without having been 
noticed by the operator becomes possible. 
[0014] 

[Example] Next, the example of this invention is explained with reference to a drawing. 
[0015] The block diagram in which drawing 1 shows the 1st example of this invention, the 
explanatory view of the detection algorithm of the specific condition of the hand 6 that drawing 2 is 
a directions actuation body, and drawing 3 are the explanatory views showing the condition that the 
finger is approaching. 

[0016] This example directs the instruction to the directions target body 5 projected on the screen 4 
by an operator 10 hand 6 ( a directions actuation body ) , processes two image pick-up signals 
acquired by two sets of the television cameras 1 and 2 ( image pick-up equipment ) arrange at a wall 
surface and head lining , respectively with an information input unit 3 , obtains said instruction so 
that it may have a different visual field to a hand 6 , and it inputs this into an information processor 
9 . In addition, the system of coordinates of three-dimensions space are taken like drawing 1 by 
making the lower right corner of a screen 4 into Zero O. 
[0017] Next, actuation of this example is explained. 

[0018] First, the image of a hand 6 is inputted into the information input unit 3 from two sets of 
television cameras 1 and 2, and the coordinate location in three-dimensions space O-xyz of the tip 
point 7 of a hand 6 is determined by processing in this equipment 3. Next, the directions target body 
5 is determined as said Japanese-Patent-Application-No. No. 053565 [ three to ] specification using 
the approach of a publication from the tip point 7 and a reference point 8. Next, the specific 
condition or specific condition sequence of a hand 6 is identified, and the information beforehand 
decided corresponding to this condition or this condition sequence is inputted into an information 
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processor 9 as instruction information over directions target body 5 grade. Drawing 2 explains this to 
a detail. 

[0019] In this example, the number of the finger opened among the conditions of a hand 6 is 
identified, and this is used as instruction information. A grip condition is photoed with television 
cameras 1 and 2, and discernment is performed by the information input unit 3. Drawing 2 explains a 
discernment algorithm. 

[0020] (1) Start a hand 6 from a background and perform binary-ized processing. 

[0021] (2) Recognize the tip point 7 using the approach indicated by Japanese Patent Application 

No. No. 053565 [ three to J. 

[0022] (3) Determine the retrieval core 20 and the retrieval radius 21 from the location 19 of the tip 
point 7 and a wrist. 

[0023] (4) Search according to the radii-like search path 22, and count the number of the 
continuation part in field 24a - 24e of the hand 6 which exists in a path 22, and find the die length of 
each continuation part. 

[0024] (5) Count the number of an open finger from the sizes 23a-23d of each finger, the number of 
each continuation part, and die length which are the characteristic quantity of a finger. 
[0025] By choosing a suitable retrieval core and a retrieval radius, it is possible to make a search 
path into the shape of easy radii. Moreover, the count stabilized even when each finger like drawing 
3 did not separate and adhered is made by using the information on the size of a finger. In addition, 
the effect by a noise etc. can be removed from the extracted continuation part by using the 
information on the size of a finger. 

[0026] In this example, although human being's hand 6 is used as a directions actuation body, this 
may use the part of other bodies, such as a guide peg and opening, and indicators, such as a rod. 
Furthermore, although two sets of television cameras 1 and 2 are arranged on a wall surface and the 
head lining in this example, two or more television cameras should just be arranged in the location 
which can obtain a stereo image. In addition, information, such as a size of a finger, is inputted into 
the information input unit 3 from an information processor 9. Moreover, the information inputted 
into an information processor 9 is not restricted to instruction information. Instruction information 
other than directions target body 5 may also be inputted into coincidence. 
[0027] Drawing 4 is the block diagram showing the 2nd example of this invention. 
[0028] This example uses together the speech information "be", and "be fastidious", and inputs the 
instruction information over the directions target body 5. [ of specific actuation of a hand 6, a 
condition, and an operator 10] 

[0029] An operator's 10 voice is incorporated and interpreted by the voice recognition unit 12 
through a microphone 11, and is led to the information input unit 3. The information input unit 3 
performs various actuation to arbitration combining specific conditions, such as specific actuation of 
directions actuation of an operator 10, closing motion of the thumb, etc., and a number of a finger, 
and an operator's 1 0 speech information. Here, to how to combine the various above-mentioned 
information, the following can be considered, for example. 
[0030] 

- an index finger — directing — the thumb — selection and an index finger — directing — "be", and "be 
fastidious" — selection and voice can be made into a trigger with the said voice, synthesized speech 
and various tone can perform guidance to an operator 1 0 "most" selection and by [ which are 
selection only with voice, such as "opening", ] combining an audio output device 13 and a 
loudspeaker 14 by the number of a finger, and more natural actuation is possible. 
[0031] Drawing 5 is the block diagram showing the 3rd example of this invention. 
[0032] In this example, in the 1st example, the infrared lighting system 15 which illuminates a hand 
6 is formed, and the infrared lighting system 1 5 and television cameras 1 and 2 are equipped with the 
light cut-off filters 16, 17, and 18, respectively. 

[0033] Usually, when performing an image processing, supplemental lighting is used in many cases 
for the stable processing. However, for an operator, supplemental lighting gives unnatural sensibility 
and leads to the displeasure of actuation. Here, the stable image processing becomes possible, 
without making an operator conscious of the illumination light, if it illuminates using the light of the 
wavelength of the outside human being's visible region. In this example, the infrared LED array is 
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used as illumination light. This can obtain the infrared light of the target wavelength easily, and, 
moreover, has the advantage that there is little power consumption. The light cut-off filter 16 is used 
all over LED, and it is letting only the light of an infrared region pass. Therefore, existence of the 
illumination light is not known by the operator 10. Moreover, by equipping with the filters 17 and 18 
same also at the tip of television cameras 1 and 2, the effect by usual lighting, such as a fluorescent 
lamp, is lost, and the stable processing only by infrared lighting is attained. 
[0034] In addition, an infrared lighting system is formed and it is applicable also to the input 
approach of the 2nd example and the conventional information to equip a television camera with a 
light cut-off filter. 
[0035] 

[Effect of the Invention] As explained above, this invention has the following effectiveness. 
[0036] (1) Invention of claim 1 can input more information by identifying the specific condition or 
its specific condition sequence of a directions actuation body, and inputting the information over a 
directions target body. 

[0037] (2) Invention of claim 2 can perform actuation to a directions target body in a more natural 
form by inputting information combining specific actuation of a directions actuation body, and the 
speech information of a condition and an operator. 

[0038] (3) While invention of claims 3 and 4 illuminates a directions actuation body using a non- 
light lighting system, the image processing of it stabilized without having been noticed by the 
operator becomes possible by equipping image pick-up equipment with a light cut-off filter. 
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* NOTICES * 

JPO and INPIT are not: responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



[Drawing 1] 




[Drawing ^] 
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[Drawing 4] 
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[Drawing 5] 
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